Comparison of faculty and student evaluations of the hybrid teaching of orthopedics during the COVID-19 pandemic

Background@#In the face of the COVID-19 pandemic and a country-wide lockdown, the University of the Philippines College of Medicine halted face-to-face teaching in exchange for online learning for its students. For the Learning Unit VI students, clinical rotations shifted to hybrid activities to continue learning activities while minimizing exposure risk. The Philippine General Hospital Department of Orthopedics introduced the following hybrid activities in its curriculum for Learning Unit VI students: 1) Online Lectures, 2) Online Departmental Conference, 3) Online Division Rounds, 4) Online SGDs, 5) Written Case, 6) Online Exams, 7) Preceptorship, Demo, Return Demo, and 8) Online OSCE. The department used a variety of platforms including synchronous sessions, asynchronous pre-recorded lectures, and face-to-face teaching, as appropriate. @*Objectives@#The study compared the faculty and student course evaluations of activities in the hybrid ORTHO 251 course. @*Methodology@#Faculty and students were asked to evaluate each activity according to the Course Evaluation By Students (CEBS), the standard questionnaire used by the college, to determine the overall rating of each activity as well as any differences between the two groups. @*Results@#The hybrid activities conducted in the ORTHO 251 course were rated as good or excellent by the faculty and students, with differences in a few activities. Consultants rated online exams as being less effectively integrated and that there was inadequate time allotment for online SGDs, written cases, and online exams. Meanwhile, students rated all activities higher in terms of stimulating self-directed learning. @*Conclusion@#With good to excellent outcomes, this study found that it has at least satisfactorily matched the learning platform to the learning component. While knowledge may be taught via asynchronous recorded lectures or reading materials, attitude and thinking processes are better formed through synchronous discussion. Skills in medical education, including Orthopedics, are still best taught via face-to-face demoreturn demo. With this information, the department can investigate the causes of these differences and improve on the identified weaknesses.

Orthopedic residents’ perception of a hybrid hand surgery rotation during the COVID-19 pandemic at the Philippine General Hospital: A qualitative and quantitative study

OBJECTIVES@#The objectives of the study were to determine the resident-physicians’ perspectives with regards the changes implemented in their Hand Surgery rotation at the Philippine General Hospital in response to the COVID-19 pandemic, and establish correlation, if any, of these perspectives to their performance in the said rotation based on their final grades.@*METHODS@#Thirteen (13) residents were chosen for the study, all of which had rotated with the division at least once after the implementation of the changes were made, to answer an online survey and participate in an online group discussion, focusing on their feedback on the effects of these changes in terms of their skills and overall patient care.@*RESULTS@#In general, the participants agreed strongly to the usefulness of the hybrid set-up with Likert survey answers ranging from 3.5 to 4 points in favor of the changes implemented. Eleven of the 13 participants had their mean survey answer scores matched with their respective grades obtained during his/her rotation with the division, showing no correlation.@*CONCLUSION@#The study showed a generally positive perception by the orthopedic residents to the hybrid set-up in the Hand Surgery rotation in response to the COVID-19 pandemic. No clear correlations or trends were seen between the trainees’ perceptions of the changes implemented and his/her objective performance based on the final grade for his/her rotation. Potential topics for investigation related to this may focus on using larger sample size or clinical outcomes of cases done by trainees who have undergone the hybrid training set-up.

A cross-sectional study on the knowledge in musculoskeletal medicine of undergraduate medical students in a national university

OBJECTIVES@#This study aimed to compare the evaluation results of University of the Philippines - College of Medicine (UPCM) Learning Unit VI (LU VI) students in their Musculoskeletal (MSK) year-end module examination and final module grade to their results in the MSK 30 examination. It likewise sought to assess the adequacy of the institution’s current curriculum on the basis of the most clinically relevant MSK topics included in the MSK 30.@*METHODS@#The knowledge of the students in Musculoskeletal medicine was determined using the MSK 30 validated exam and this was compared to their results in the various evaluation tools of the present MSK curriculum. The results were subjected to statistical analysis using (1) the Pearson correlation coefficient and (2) item analysis. @*RESULTS@#Despite exhibiting above average performance in the MSK module, the performance of the 66 (N=187) LU VI students in the MSK 30 showed otherwise with a passing rate of only 48.48%. There was no statistically significant correlation between the MSK 30 and the year-end module examination (p value = 0.77, CI 90%, ME 8%), and the final module grade (p value = 0.92, CI 90%, ME 8%). It was noted that the students did poorly in the following topics: Environmental Injury, Head Injury, Infection, Pediatrics, Spine, and Sports Injuries.@*CONCLUSION@#Undergraduate medical students of the University of the Philippines - College of Medicine performed poorly in the MSK 30 despite a generally good performance in the prescribed MSK module. Whether this is indicative of inadequacies in the existing MSK curriculum or is due to the MSK 30 not being appropriate to the local setting will need to be determined.

Effect of a consignment policy on outcomes of orthopedic emergency trauma patients in a tertiary hospital

OBJECTIVES@#Implants for traumatic orthopedic injuries are costly, and usually borne by the patient. We determined whether a consignment policy decreases morbidity and mortality rates, decreases length of stay, and decreases total expenditure of our patients.@*METHODS@#This is an ambispective cohort study comparing patients whose orthopedic implant surgeries were done before consignment policy and thus paid for out-of-pocket (Group A), and patients whose surgeries were done under the policy, and whose implants were paid for by hospital funding (Group B). Patient records and hospital bills were reviewed. A total of 206 patients were included in the study, and we gathered data from department and hospital records regarding the incidence of morbidity, mortality, length of stay, and total hospital expenditure.@*RESULTS@#In this study, we demonstrate no difference in the incidence of morbidities and mortalities between the two groups. There was also no significant difference in the total hospital expenditure of both. There is a slightly shorter preoperative stay, and significantly longer postoperative and total hospital stays for Group B patients.@*CONCLUSION@#The consignment policy, in its first year of implementation, demonstrated no difference in the incidence of morbidity and mortality, or total hospital expenditures. Further long-term studies may be undertaken to improve accuracy of results.

Comparison of faculty and student evaluations of the hybrid teaching of orthopedics during the COVID-19 pandemic

Background@#In the face of the COVID-19 pandemic and a country-wide lockdown, the University of the Philippines College of Medicine halted face-to-face teaching in exchange for online learning for its students. For the Learning Unit VI students, clinical rotations shifted to hybrid activities to continue learning activities while minimizing exposure risk. The Philippine General Hospital Department of Orthopedics introduced the following hybrid activities in its curriculum for Learning Unit VI students: 1) Online Lectures, 2) Online Departmental Conference, 3) Online Division Rounds, 4) Online SGDs, 5) Written Case, 6) Online Exams, 7) Preceptorship, Demo, Return Demo, and 8) Online OSCE. The department used a variety of platforms including synchronous sessions, asynchronous pre-recorded lectures, and face-to-face teaching, as appropriate. @*Objectives@#The study compared the faculty and student course evaluations of activities in the hybrid ORTHO 251 course. @*Methodology@#Faculty and students were asked to evaluate each activity according to the Course Evaluation By Students (CEBS), the standard questionnaire used by the college, to determine the overall rating of each activity as well as any differences between the two groups. @*Results@#The hybrid activities conducted in the ORTHO 251 course were rated as good or excellent by the faculty and students, with differences in a few activities. Consultants rated online exams as being less effectively integrated and that there was inadequate time allotment for online SGDs, written cases, and online exams. Meanwhile, students rated all activities higher in terms of stimulating self-directed learning. @*Conclusion@#With good to excellent outcomes, this study found that it has at least satisfactorily matched the learning platform to the learning component. While knowledge may be taught via asynchronous recorded lectures or reading materials, attitude and thinking processes are better formed through synchronous discussion. Skills in medical education, including Orthopedics, are still best taught via face-to-face demoreturn demo. With this information, the department can investigate the causes of these differences and improve on the identified weaknesses.

Using Video Recording in Evaluating Skills of Medical Students in the Performance of the Orthopedic Examination

@#OBJECTIVE: The study aims to assess the similarity between the results of the evaluation of students during an Objective Structured Clinical Examination (OSCE) and a video recording of the same OSCE (VOSCE). METHODS: All Orthopedic surgeon preceptors in the actual OSCE were recruited to the study. Video recordings of the students taking the OSCE were collected and later reviewed and re-evaluated by the same preceptor after at least four weeks. The grades of actual OSCE and VOSCE were collected and analyzed using Cohen’s kappa coefficient. RESULTS: High variability of intra-rater reliability was observed in different preceptors and station (slight agreement to perfect agreement). Overall intra-rater reliability between actual and video OSCE showed moderate agreement with Cohen’s kappa coefficient equal to 0.43 (n-219). CONCLUSION: Video OSCE is a reliable tool in assessing student clinical skills and knowledge in the musculoskeletal examination. Some factors have been suggested to further improve reliability.

Using Video Recording in Evaluating Skills of Medical Students in the Performance of the Orthopedic Examination

@#OBJECTIVE: The study aims to assess the similarity between the results of the evaluation of students during an Objective Structured Clinical Examination (OSCE) and a video recording of the same OSCE (VOSCE). METHODS: All Orthopedic surgeon preceptors in the actual OSCE were recruited to the study. Video recordings of the students taking the OSCE were collected and later reviewed and re-evaluated by the same preceptor after at least four weeks. The grades of actual OSCE and VOSCE were collected and analyzed using Cohen’s kappa coefficient. RESULTS: High variability of intra-rater reliability was observed in different preceptors and station (slight agreement to perfect agreement). Overall intra-rater reliability between actual and video OSCE showed moderate agreement with Cohen’s kappa coefficient equal to 0.43 (n-219). CONCLUSION: Video OSCE is a reliable tool in assessing student clinical skills and knowledge in the musculoskeletal examination. Some factors have been suggested to further improve reliability.